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I.  INTRODUCTION 


The  objective  of  the  Army  materiel  acquisition  process  can  be  stated  quite 
•i*piy:  to  supply  the  Army  with  equipment  which  will  optimally  assist  in 
winning  future  wars.  Given  that  goal,  how  best  can  we  decide  what  equipment 
and  systems  to  build  and  what  their  characteristics  ought  to  be? 

Before  exploring  possible  answers  to  that  question,  let'n  list  the  major  steps 
in  the  acquisition  of  an  item-level  system,  which  we  take  here  to  mean  a  tank, 
a  missile  system,  a  self-propelled  howitzer  or  some  similar  item.  They  are: 

A]  Define  the  need  for  a  given  item  (system) 

B]  Define  the  optimal  characteristics  of  that  system  l.e.  how  to 
sort  out  the  benefits  and  burdens  of  various  options 

C]  Postulate  specific  system  designs  and  analyse  in  detail  the 
degree  to  which  candidate  designs  meet  the  criteria  of  B] 

D]  Build,  test,  and  modify  the  prototype  to  see  whether  C] 
(developed  in  theory)  can  be  actualized 

E]  Build  the  Inventory. 

Whet  kind  of  rational  tools  does  the  Army  have  that  might  be  used  to  address 
steps  A]  through  C] ?  Various  war  games  are  available,  each  addressing  a 
particular  level  of  battlefield  integration.  From  top  down,  those  levels  are 
1]  Theater,  2]  Corps,  3]  Division,  4}  Battalion,  5]  Unit,  and  6]  Item  (One- 
on-One) .  The  focus  of  this  paper  is  on  the  requirements  for  Item-Level 
Modeling,  level  6]. 

It  is  this  level  at  which  Individual  weapons  are  examined  in  greatest  detail; 
this  Includes  the  diverse  aspects  of  vulnerability,  mobility,  structural 
Integrity,  signature,  and  lethality.  This  level  should  play  a  central  role  in 
developing  system  concepts,  design  optimisation,  evolving  battlefield 
strategies,  and  logistics  planning. 

It  can  be  seen  that  in  level  6],  Item-Level  Modeling  provides  the  rational 
techniques  by  which  step  C]  of  the  item-level  acquisition  process  can  take 
place.  It  would  appear,  then,  that  steps  A]  and  B] ,  the  definition  of  the 


(•rural  and  specific  characteristics  of  sy steal  Itself  should  arlso  from  the 
higher  levels  In  an  analytic  hierarchy,  3)  the  Unit  level  and  above  (levels  1) 
through  4]) . 

In  this  paper  we  will  discuss  how  system  concepts  are  developed  in  the  Army 
today,  where  we  perceive  shortcomings ,  and  what  sight  be  done  to  address  the 
shortfalls . 


II.  STATUS  QUO 

How  does  the  Any  currently  sort  through  steps  A]  through  E)  In  the 
acquisition  process?  Ue  assert  that  currently  the  choice  of  a  particular 
class  of  end  Item  (step  A])  Is  made  by  assentlally  a  subjective  process.  It 
Is  decided  that  "The  Arsy  needs  a  new  Infantry  Fighting  Vehicle  (IFV) .  ■  This 
decision  say  be  subjectively  influenced  by  war  gases  run  at  levels  3]  or 
higher,  but  to  the  best  of  our  knowledge,  for  example,  there  Is  no  unit-level 
sodel  which  has  been  designed  to  sort  through  the  ayrlad  of  options  for 
general  systea  definition. 

When  It  coses  to  Issue  B] ,  defining  the  optlaal  characteristics  of  the  fussy 
systea  defined  In  step  A],  there  do  not  appear  to  be  sore  objective  tools. 
For  exasple,  there  Is  no  unit- level  sodel  that  has  been  configured  to  assess 
the  battlefield  effectiveness  of  IFVs  as  a  function  of  the  dosen  or  so  aost 
dominant  Measures  of  systea  perforaance.  Rather,  at  an  early  concepts  stage, 
systea  specifications  are  generated  by  a  coaslttee  of  experts  for  various 
aspects  of  Ites- level  subsystems.  If  the  Issue  Is  a  IFV,  a  panel  Is  forsed  of 
armor,  nobility,  and  weapons  experts.  Invariably,  each  expert  proposes 
specifications  for  his  area  cf  expertise  based  on  his  perception  of  the 
highest  achievable  goals,  Irrespective  of  the  required  benefits  or  Implied 
burdens  that  such  an  process  entails.  Thus  systems  specifications  arise  based 
on  what  technology  can  provide  on  a  discipline  by  discipline  basis,  not  on 
what  the  actual  benefits  could  be  achieved  based  on  an  Integrated  systea 
approach  which  reflects  optimal  design  criteria. 

This  node  of  operation  has  a  number  of  unfortunate  ramifications.  One  area 
that  has  gotten  little  attention  until  recently  Is  logistics  support.  Syetea 
acquisition  has  been  approached  as  though  unit  purchase  costs  and  subsystem  by 
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subsystem  performance  vara  tha  kay  drlvara.  In  fact  it  la  now  racognizad  that 
tha  llfatlaa  logiatic  coata  and  tha  accoapanylng  laauaa  of  reliability, 
availability,  and  aalntalnability  (RAM)  ara  tha  kay  attributaa.  Today* a 
committee-decision  approach  for  aattlng  ayataa  apacificatlona  (Issue  B])  la 
incapabia  of  da a ling  with  tha  issue,  "Should  a  aodarn  battla  tank  hava  a  craw 
of  thraa  ins toad  of  fourV" ;  or  "Should  tha  naxt  IFV  trada  thraa  tons  of  armor 
protection  to  gain  an  incraasad  top  spaad  of  IS  mph?"  Tha  fontar  question 
raises  questions  about  poaaibla  reduced  effectiveness  for  a  specific  (tank) 
system,  but  tha  advantage  of  spreading  tha  same  number  of  troops  over  a  30% 
increase  in  tha  number  of  vehicles  is  never  addressed.  The  latter  question 
poses  a  typical  Operations  Research/Systems  Analysis  (ORSA)  conundrum.  We'd 
like  to  have  both  high  protection  and  high  mobility,  but  the  reality  of  all 
our  systems  is  that  they  are  constrained.  And  the  constraints  are  many;  cost 
is  one,  weight  is  another,  size  (to  fit  on  a  C  141)  is  another.  Weight  (of 
armor)  helps  in  protection,  but  hurts  in  mobility.  The  synerglsms  and 
conflicts  are  many,  and  probably  the  key  aspect  of  this  problem  is  the  manner 
in  which  system  integration  takes  place.  It's  unfortunate  that  the 
Integration  process  must  rely  so  heavily  on  a  subjective  approach. 

What  about  step  C]  of  the  acquisition  process?  Here  the  Army  tends  to  do  a 
bit  better.  Although  we  have  incomplete  and  predominantly  subjective  system 
specifications  to  work  towards,  many  aspects  of  projected  performance  are 
examined.  Design  factors  Involving  chassis  strength,  mobility,  armor 
protection,  fire  control  have  tended  to  get  high  scrutiny  over  the  years. 
Other  factors  such  as  system  design  practice  so  as  to  achieve  minimal 
detectivity  in  the  battlefield  have  received  little  or  no  attention  until 
recently. 

A  significant  factor  in  the  ability  to  perform  detailed  system  analyses  In  a 
timely  fashion  has  been  the  emergence  of  new  aet  of  high- resolution 
engineering  tools  built  around  Computer-Aided  Design  (CAD)  techniques. 
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The  subject  of  an  earlier  AORS  paper ^  tha  kay  theme  is  that  tha  great  Majority 
of  currant  ay at as  analyaaa  raqulra  detailed  thraa - dlmena lonal  geometry  in 
order  to  ba  performed.  Quaatlona  relating  to  system  weight,  protection, 
aignatura,  ate.  all  are  baaed  in  part  on  geometry  (and  accompanying  Material 
propartiaa)  and  varloua  aapacta  of  performance.^,  *  Although  auch  analytic 
toola  are  not  unlvaraally  uaad,  there  la  a  rapidly  growing  awareneaa  that  they 
are  lncreaalngly  required  to  give  both  tha  required  free  la  ion  in  Many 
inveatlgatlona  and  tha  ability  to  perform  ay a tarn  integration  and  tradeoffs. 


Tha  expected  raault  of  procaaa  C]  ia,  at  ba'r  a  looae  dealgn  of  a  ayataa,  ao 
that  tha  real  aapacta  of  integration  are  left  to  tha  prime  contractor  to  aort 
out.  Finally,  a  prototype  la  built  and  taatad  agalnat  tha  (Incomplete) 
criteria  which  have  evolved  in  phaaea  B)  and  C) . 


111.  AM  EXAMPLE 


To  underatand  better  how  ayataa  deflnltlona  and  requirement*  are  formulated 
today,  we  dlacuaa  a  aet  of  ayatema  now  under  conaideratlon  by  the  Any,  The 
Arnored  Family  of  Vehicle*  (AFV) .  The  Any  la  now  faced  with  a  aet  of 


1.  P.  H.  Delta,  "Solid  Geometric  Modeling  -  the  Kay  to  Improved  Materiel 
Acqulaltlon  froa  Concept  to  Deployment",  in  the  Proceedings  of  t he  XXII 
Annual  Meeting  of  the  Army  Operations  Research  Symposium,  5-5  October 
1983,  Ft.  Lee,  VA,  pp.  4-243  to  4-269. 

2.  P.  H.  Delta,  "Predictive  Signature  Modeling  via  Solid  Geometry  at  the 
BRL,"  Proceedings  of  the  Sixth  KRC  Symposium  on  Ground  Vehicle  Signatures , 
21-22  August  1984,  Houghton,  MI. 

3.  P.  H.  Delta,  "Modern  Computer-Aided  Tools  tor  High-Resolution  Weapons  Sys¬ 
tem  Engineering,"  Proceedings  of  the  CAD/CAM  Mini -Symposium,  M TAG  84,  28- 
29  November  1984,  Seattle,  VA,  pp.  23-42  (Published  by  VS  Army  Industrial 
Base  Engineering  Activity,  Rock  Island,  IL.) 

★  The  study  of  the  AFV  requirements  is  being  lad  by  Systems  and  Technology 
Planning  Office,  TACOM.  The  author  wishes  to  emphasis*  that  the  us*  of 
this  particular  program  to  illustrate  perceived  shortcomings  in  the  pro¬ 
curement  process  is  not  meant  to  reflect  negatively  on  the  program. 
Through  hla  personal  Involvement  in  the  AFV  study,  he  can  attest  that  the 
the  SAT  Planning  Office  is  well  aware  of  these  philosophic  problems. 


decisions  sbout  how  it  will  doslgn  and  cons ti tuts  its  futurs  flsst  of  ground 
fighting  vshlclss .  Ths  philosophic  dspsrturs  for  currsnt  futurs  systems  is 
tsksn  from  "Army  21,  A  Concept  for  ths  Future".*  Army  21  Is  ths  US  Army's  wsr 
fighting  concept  for  ths  ssrly  21st  Century.  Following  an  overview  of  the 
future  field  of  conflict,  it  gives  s  listing  of  the  future  force 
cherecterlstlcs.  Some  of  these  ere  given  in  Figure  1.  Eech  of  these  desired 
future  force  cherecterlstlcs  is  Attractive  end  deslreble.  As  noted  eerller, 
the  reellty  of  system  design  requires  thet  difficult  decisions  must  be  mede  on 
competing  Attributes.  Also  as  noted  before,  there  is  no  rational, 
quantitative  set  of  metrics  based  on  a  war  game  eoenerio  which  actually 
ref lects  optimized  attributes  in  terms  of  a  "modeled"  Army  21. 

Furthermore,  Army  21  focuses  on  technology  bases  which  provide  support  to 
achieve  future  system  requirements.  The  identified  capabllltles/technologles 
are  given  in  Figure  2.  Army  21  states*  that  "there  must  be  a  thorough 
assessment  of  the  overall  benefits  of  the  technology  before  specific  materiel 
requirements  can  be  developed."  The  document  further  states  that  "To  make  Army 
21  achievable,  the  AMC/TRADOC  partnership  must  create  a  disciplined  process 
for  incorporating  the  Army  21  philosophy  throughout  the  materiel  development 
cycle  from  this  point  on  into  the  21st  century."* 

To  return  to  the  AFV  planning  process,  a  (loose)  set  of  design  criteria  have 
been  Inferred  from  the  scenarios  implied  by  Army  21.  An  0&0  Plan*  thus 
further  distills  Army  21  to  provide  technology  guidance  and  threat/deficiency 
definitions.  In  yet  another  fundamentally  subjective  step,  a  Special  Study 


4.  Draft  version  prepared  by  the  USA  Training  and  Doctrine  Co— and,  Ft.  Mon* 
roe,  VA. 

5.  See  reference  4,  page  S. 

6.  "Draft  Umbrella:  Operational  and  Organisational  Plan  for  Armored  Fam ily  of 
Vehicles",  final  draft  prepared  by  the  USA  Training  and  Doctrine  Command, 
Ft.  Monroe,  VA.  (August,  1985) 
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a.  Snail,  salf-sufflelant  organisations 

b.  High  aoblllty  -  counternobility 

c.  Flrapowar  intensive 

d.  Lass  aanpovsr  rallant 

a.  Extreaely  agile  -  quick  dispersion  and  nesting 
capability 

f.  Capable  of  fluid,  continuous  operations 

g.  Rapid  strategic  deployability 


a.  Lass  fuel  consuning  -  energy  efficient 
n.  Stealth  equipaent  (reduced,  aultiple  or  ■ tend- of 
signatures) 


t.  Coanonality  of  equipaent 


Figure  1.  Exaaples  of  the  General  Force  Characteristics  as  Given 

in  "Aray  21,  A  Concept  for  the  Future. "(See  reference  5, 
pp.  5-1  to  5-2) 


«.  Firepower  - 

.  Lethality  .  Fire  Control 

..  Extended  Range  .  Robotics 

.  Smart  Sensors 


b.  C3I  - 

,  Command,  Control, 
.  Intelligence 

c.  Mobility  - 

.  Light  Weight 
.  Miniaturization 
.  Navigation 
.  Robotics 
.  Common  Platforms 

d.  Survivability  - 

,  Detection 
.  Hit 

e .  Support  - 

.  Supply 
.  Maintenance 
.  Transportation 


and  Communications 


.  Propulsion 
.  Countermine 
.  Gap/Obstacle  Crossing 
.  Countermobility 


.  Vulnerability 
.  Repairablllty 


.  Field  Services 
.  Simulators  and  Training 
.  Devices 


2.  Technology  Bases  Which  Support  the  Future  Requirements 
(See  reference  5,  pp  7-3  to  7-4) 


Group,  Armor,  developed  the  following  design  objectives  for  the  AFV: 

«]  Mexlmum  Component  Commonality 

b]  Common  Vetronlcs^  Architecture 

c]  Maximum  Chassis  Commonality 

d]  Multiple  System  Capabilities 

e]  Modular  Capabilities 

f]  Common  Signatures. 

Here  again,  although  the  AFV  060  provides  some  goals  which  offer  payoffs, 
there  Is  nothing  In  the  way  of  quantitative  system  criteria  that  can  used  as 
concrete  objectives  In  the  system  design  process. 

For  example,  objectives  a]  through  d]  seem  to  be  reasonable  goals,  but  just 
what,  for  example,  Is  "Maximum  Component  Commonality"  and  for  what  criteria 
does  It  occur?  Other  questions  arise.  What  are  the  benefits  and  burdens  of 
using  a  common  chassis (s)  and  turret -ring  variants  to  address  the  29  or  so 
Identified  battlefield  missions  vice  generating  29  separate,  individually 
optimized  designs?  Ignoring  for  a  moment  cost  factors  (which  are  a  major 
influence) ,  we  seek  an  analytic  "scenario"  Into  which  we  can  place  candidate 
"optimized"  and  "compromised"  designs  to  test  ef fertlvaness .  However 
currently,  we  have  no  (quantitative)  measure (s)  of  system  effectiveness. 
Other  questions  can  be  raised.  Why  should  we  have  common  signatures?  Why  not 
have  minimal  signatures  where  reasonably  achievable  and  the  payoff  Is  there? 
Further,  within  each  signature  band,  why  not  randomize  the  signals  so  as  to 
make  target  classification  more  difficult?  Again,  there  is  no  way  to  test 
this  hypothesis,  since  we  have  no  quantitative  metric  which  reflects  the 
scenario(s)  for  which  we  are  presumably  designing. 


7.  Vetronlcs  (Vehicle  Electronics)  is  an  initiative  to  integrate  advanced 
electronic  systems  using  bus  concepts  for  data  and  control. 
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IV.  TOWARDS  A  MORE  RATIONAL  DECISION  PROCESS 


Clearly,  the  establlshaent  of  quantitative  ay i ten  design  criteria  is  a 
difficult  and  challenging  problem.  This  is  due  to  a  number  of  factors 
including  the  high  dimensionality  as  veil  as  the  general  Interdependence.  How 
can  this  situation  be  approached? 


As  an  approach  to  analyzing  complex  systems  Deaton  has  reviewed  some  methods 

g 

which  can  be  characterized  as  subject!:'*  in  nature.  She  asserts  that 

"Decision  making  can  be  divided  into  four  phases:  (1)  recognition 
of  a  decision  problem  and  definition  of  its  nature  and  dimensions, 

(2)  probability  measurement,  (3)  outcome  evaluation,  l.e.,  how  good 
or  bad  the  outcome  is,  and  (4)  choice  -  usually  the  alternative 
which  has  the  highest  expected  value  or  which  returns  the  most 

value  per  unit  cost." 


In  addition,  techniques  such  as  task  decomposition  can  assist  in  the  analysis 
of  complex  processes. ^ 

"Decomposition  ...  is  described  j  specification  of  choice 
alternatives  which  are  usually  defined  as  a  set  of  consequences 
following  from  the  alternatives.  At  this  level,  utilities  are 
assigned  to  the  outcomes,  and  expected  utilities  are  computed  for 
course  of  actions . " 


This  process  of  decomposition  can  continue  to  lower  levels.  As  this  process 
continues,  complex  tasks  are  are  resolved  into  simpler  subtasks.  However, 
these  processes  often  involve  probabilities  and  effects  which  are  unknown  to 
the  analyst.  This  is  the  case  we  are  presented  with  here,  without  some 
analytic  extensions  to  current  war  game  capabilities. 


8.  M.  D.  Deaton,  "Utility:  Recent  Theory  and  Some  Applications,"  U.  of  Wash 
Tech.  Rpt.  76-4,  Sept.  76. 

9.  See  reference  8. 
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However,  It  hee  been  asserted  by  Shepard 

"Because  there  Is  serious  doubt  that  man  has  the  ability  to  process 
information  involving  large  numbers  of  dimensions,  procedures 
requiring  overall  judgnents  of  worth  for  coatplex  stimuli  are 

unsuitable  for  many  real  world  problems." 

Thus  we  must  seek  techniques  which  at  least  substantially  reduce  the 
subjectivity  Involved  in  setting  system  definition  and  design  criteria  for 
weapons.  We  now  propose  an  approach  with  just  such  a  goal. 

A.  Probability  of  Mission  Effectiveness  as  a  Figure  of  Merit 

Let  us  define  a  battlefield  system,  S,  which  is  characterized  by  N 
quantitative  Measures  of  Performance  (MoP) .  Typical  MoPs  might  be  the 
magnitude  (in  mm  equivalent  RHA)  of  KE  protection  for  horizontal  attack  ,  the 
magnitude  of  system  radar  cross  section  (in  sq  am,  which  relates  to  the 
probability  of  detection  in  the  battlefield),  the  mobility  of  the  system  (top 
speed,  agility),  etc.  Figure  3  lists  some  examples  of  MoP  that  might  be 
relevant  for  an  IFV.  Next,  a  unit-level  war  game  (ULWG,  Level  5,  Section  I.) 
must  be  configured  so  es  to  reflect  a  particular  scenario  according  to  the 
systems,  strategies,  and  deployments  implied  by  Army  21.  This  is  done  with  a 
specific  mis  alow  in  mind.  A  particular  mission  might  require  an  IFV  to 
traverse  from  point  A  to  point  B  within  some  maximum  time  and,  when  reaching 
Point  B,  successfully  employ  its  main  armament  to  destroy  a  particular  target. 
The  ULWG  must  include  the  N  dimensions  by  which  system  S  is  to  be 
characterized.  Next  a  set  of  values  is  chosen  for  each  of  the  N  MoPs,  and  the 
progress  of  system  S  to  the  goal  (destruction  of  a  target  upon  reaching  Point 
B)  is  followed.  If  System  S  with  the  given  set  of  MoPs  accomplishes  its 


10.  R.  N.  Shepard,  "On  Subjectively  Optimum  Selections  Among  Multi -Attribute 
Alternatives,"  in  M.  V.  Shelley  and  G.  L.  Bryan,  Human  Judgments  and 
Optimality,  New  York:  Wiley,  1964,  pp.  257-281. 

*  RHA  stands  for  Rolled  Homogeneous  Armor;  KE  stands  for  Kinetic  Energy 
round,  one  type  of  antitank  warheads. 
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MoP^  -  Mobility /Improved-Road 
MoP2  -  Mobility /Rough -Terrain 
MoP^  -  Magnitude  of  CE  Protection/Horizontal 
MoP^  -  Magnitude  of  CE  Protection/Vertical 
Mo'1  -  Magnitude  of  KE  Protection/Horizontal 
MoFg  -  Magnitude  of  KE  Protection/Vertical 
MoP?  -  Probability  of  Visual  Detection 
MoPg  -  Probability  of  Acoustic  Detection 
MoP^  -  Probability  of  IR  Detection 
MoP^q  -  Probability  of  MMtf  Detection 
MoPn  -  Magnitude  of  Neutron  Shielding 
MoP^2  “  Number  of  Crew  Members 
MoP^  -  Lethality  of  Main  Cun 


Figure  3.  Examples  of  Measures  of  Performance  (MoP)  for  a  Particular  System. 


11 


mission,  the  simulation  ao  notes  it,  and  repeats  the  stisslon  with  the  sene  N 
MOP  values  but  with  a  new  set  of  stochastically  drawn  parameters  for  the  ULVG. 
These  would  include  hit  probabilities  of  red  systems,  weapons  effects, 
detection  probabilities  of  red  surveillance  systems,  etc.  After  many 
iterations,  a  probability  function  would  be  generated  for  System  S  In  this 
specific  scenario  for  the  Probability  of  Mission  Effectiveness  (PME) ,  where 

PME'  -  F[MoP' MoP'2,  MoP'3,  .  .  .  MoP'jj], 

and  the  primes  (')  indicate  that  PME  has  been  calculated  for  one  set  of  MoPs. 
A  value  of  unity  means  that  the  mission  is  accomplished  1C0%  of  the  time  for 
the  given  set  of  MoPs.  If  two  sets  of  MoPs  both  yield  a  PME  of  unity,  the 
effectiveness  between  the  two  systems  is  indeterminate.  The  simulation  is  no\b 
repeated  for  many  combinations  of  MoPs  so  that  a  probability  function  based 
on  N  independent  variables  is  defined 

PME  -  F[MoPr  MoPg,  MoP3,  .  .  .  MoPN] . 


PME  is  clearly  a  complicated  function  which  will  not  be,  for  example,  a  linear 
combination  of  the  MoPa.  To  the  contrary,  as  noted  above,  many  MoPs  are 
likely  to  be  dependent  (eg.  mobility,  weight,  size,  etc.).  With  a  PME  thus 
defined,  not  only  can  the  effect  of  changing  a  given  MoP  be  ascertained  while 
holding  other  MoPs  constant,  the  importance  to  battle  field  mission  of  a  given 
MoP  can  be  inferred  by  examining  the  contribution  of  other  MoPs  to  the  success 
of  that  defined  mission. 

Having  generated  a  PME,  we  can  now  proceed  to  the  evaluation  of  specific 
systems.  A  system  concept  can  be  generated;  as  noted  in  Section  II.,  the 
actual  system  should  be  modeled  using  solid  geometry  techniques.  The  N  MoPs 
can  be  generated  using  tools  of  the  type  noted  in  references  1*3.  The  MoPs 


*  Ve  will  ignore  here  the  practicalities  of  this  approach  including  the  fact 
that,  if  poorly  formulated,  the  required  amount  of  calculation  can  become 
intractable . 
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can  be  plugged  into  the  PME  function  so  that  the  mission  effectiveneaa  of  this 
particular  system  is  derived. 


As  this  process  is  repeated  for  a  number  of  specific  candidate  designs,  both 
the  relative  and  the  absolute  values  of  competing  designs  can  now  be  judged. 
In  addition,  by  examing  the  statistics  derived  during  the  calculation  of  the 
PME  function  (including  the  shape  of  its  probability  surface  in  hyperspace)  we 
can  infer  the  direction  that  design  philosophy  ought  to  take  in  order  to 
generate  more  effective  systems. 


It  should  be  added  that  this  ULWG  must  avoid  the  problems  of  an  oversimplified 
scenario  in  which  only  one* on* one  or  one* on* few  are  played.  Both  red  and  blue 
weapons  systems  must  be  played  in  the  proper  mix  and  at  a  broad  enough  level 
of  force  involvement  to  avoid  spurious  results  and  false  (apparent) 
dependencies.  It  would  also  appear  that,  given  necessary  augmentation,  a 
number  of  extant  war  games  might  support  the  role  of  generating  PMEs.  Such 
candidates  might  be  CASTFOREM,11  JANUS,12  TANKVARS13  and  CORBAN.14 

B.  An  Example  of  Probability  of  Mission  Effectiveness 

Ve  now  give  a  trivial  example  of  this  approach  in  order  to  make  this  concept 
more  understandable.  A  mission  is  defined  for  a  supply  vehicle  to  traverse 
from  Point  A  to  Point  B.  For  this  example,  the  vehicle  will  be  characterized 
by  two  MoPs,  1]  Ballistic  Protection  (MoP^)  and  2]  Probability  of  Detection 


11.  CASTFOREM  (Combined  Arms  and  Support  Task  Force  Evaluation  Model)  was 
developed  by  the  US  Army  TRADOC  Systems  Analysis  Activity  (TEAS ANA) . 

12.  JANUS  was  developed  by  the  Lawrence  Livermore  National  Laboratory. 

13.  TANKVARS  was  developed  by  AMSAA  and  BRL. 

14.  CORBAN  was  developed  by  BDM  Corporation. 

*  This  is  the  probability  that  a  red  threat  will  detect  the  blue  system 
being  played  parametrically. 
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(MoPj) .  As  nocad  abova  tha  ULWG  la  conflgurad  ao  that  tha  appropriata 
threats,  tarralna,  and  rad/blua  strategies  ara  lncludad.  Next,  a  laval  for 
MoPa  ona  and  two  ara  choaan  and  tha  simulation  exercised  atochaatlcally .  At 
that  point  tha  PHE  la  dafinad  for  that  pair  of  MoP  valuaa.  Thla  procaaa  la 
rapaatad  for  aach  fair  of  MoPa  for  all  ranges  of  Intaraat:  a  PHE  la  thus 
ganaratad  as  a  function  of  tvo-apaca .  Tha  raaulta  of  such  a  calculation  might 
look  as  shown  In  Figura  4.  Tha  thraa  dimensional  curve  Illustrates  that  tha 
probability  of  mission  effectiveness  (PHE)  Increases  aa  Ballistic  Protection 
(MoP.)  Is  grows;  PME  also  Increases  as  tha  Probability  of  Da taction  (MoP0) 
decreases.  The  horizontal  lines  on  tha  slope  of  the  curve  Indicate  levels  of 
constant  Mission  Effectiveness.  Mixes  of  tha  twc  MoPs  on  such  Unas  imply 
equal  effectiveness. 

From  such  a  function  tha  actual  tradeoffs  between  protection  and  detection  can 
finally  be  understood  in  tha  context  of  an  actual  battlefield  scenario. 
Through  generation  of  a  PME  function,  tha  benefits  of  arbitrary  mixes  of  MoPs 
can  be  interpreted.  It  should  be  recognized  that  many  mixes  of  specific  M  ”8 
that  might  be  used  to  calculate  a  PME  may  not  bo  practically  ochlovoblo .  That 
does  not  lessen  the  value  of  the  exercise,  because  this  tool  would  give  the 
system  designer  guidance  in  the  direction  that  his  efforts  should  take.  The 
constraints  of  actual  technology  come  to  bear  when  specific  designs  are 
created  and  analyzed.  If  the  individual  MoPs  are  calculated  using  rigorous 
analysis  supported  by  solid  geometry,  then  that  particular  design  represents  a 
valid  point  in  the  domain  of  the  PME.  The  set  of  all  such  designs  in  which 
valid  technology  and  analysis  is  performed  will  then  represent  the  subset  of 
the  PME  space  for  which  we  can  realistically  develop  militaiy  systems.  In 
addition,  the  development  and  analysis  of  such  PMEs  could  point  the  way 
towards  the  development  of  high-payoff  technologies.  Ve  note  further  that  a 
number  of  PMEs  can  be  generated  for  a  given  system,  each  representing  specific 
mission  roles  that  it  should  be  capable  of  supporting. 


+  With  respect  to  the  MoP^-MoP^  plane. 
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Figura  4.  Tha  Probability  of  Mission  Effactivanass  (PNE)  as  a 
function  of  tha  Maasuras  of  Effactivanass  (NOP)  Ballistic 
Protaction (MOP  )  and  Probability  of  Dataction  (MOP.). 

For  this  siapla  two-par aaatar  systaa,  mission  affactivanass 
incraasas  with  ballistic  protaction;  it  dacraasas  with  incraasing 
probability  of  dataction.  Tha  horizontal  linas  on  tha  slopa  of 
tha  eurva  indicata  lavals  of  constant  Mission  Effactivanass. 

Mixas  of  tha  two  hoPs  on  such  linas  imply  aqual  affactivanass. 
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V.  SUMMARY  AMD  CONCLUSIONS 


V*  have  brlafly  reviewed  tha  way  In  which  tha  Army  spaclfiaa  ita  naada  for  naw 
systems  ns  wall  an  tha  apaclflc  requirements  for  thoaa  ayataaa  It  aaaaa 
claar  that  currant  procedures  ara  ovarly  dapandant  on  subjective  Input  for: 

■  Definition  of  general  item  requirements . 

a  Effectiveness  criteria  b>  means  of  which  to  focua  the  technical 
nix  of  ay a tea  performance  character la tlca . 

a  Appropriate  quantitative  analyaaa  for  a  one  aapacta  of  ayataa 
performance . 

Since  tha  ayatam  design  goals  ara  invariably  not  wall  defined  or 
quantitatively  specified,  it's  often  difficult  to  identify  crucial  design 
aspects  which  ought  to  be  the  focus  of  principal  resources. 

We  believe  these  shortfalls  can  be  addressed  by  developing  objective 
techniques  in  which  battlefield  scenarios  are  combined  with  specific  mission 
objectives  in  the  context  of  a  Unit  •Level  war  game.  It  seems  possible  that 
such  a  capability  can  be  achieved  through  augmentation  of  one  of  a  number  of 
extant  models  (e.g.  CASTFOREM,  JANUS).  By  this  approach,  one  of  which  was 
sketched  in  the  previous  section,  we  believe  that  quantitative  Measures  of 
Performance  car  be  related  to  Mission  Bf f ectlveness .  Ve  believe  that  such  an 
approach  would  bring  more  credible  scrutiny  to  competing  Army  system  concepts. 
It  would  also  identify  high  payoff  supporting  technologies  while  pointing  the 
way  tower is  optimal  designs  of  the  future. 
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Fort  Monmouth/  NJ  07703-5301 

3  Commander 

US  Army  Electronics  Research  & 
Development  Command 
Night  Vision  &  Electronic  Optics 

ATTN t  DELMV-L  (Dr.  R.  Buaer) 
AMSEL-RD-MV-V  (John  Ho) 
AMSEL-NV-V  (John  Palmer) 
Fort  Bel voir,  VA  22060-5677 

3  Commander 

US  Army  Foreign  Science  and 
Technology  Center 
ATTN:  AIAFRC  (T.  Walker) 

(S.  Eitleman) 

(R.  Witnebal) 

220  Seventh  Street,  NE 
Charlottesville,  VA  22901-5396 

1  Commander 

US  Army  Foreign  Science  a 
Technology  Center 
ATTN:  AIAF  (Mr.  Bill  Rich) 

220  Seventh  Street,  NE 
Charlottesville,  VA  22901-5396 

1  Commander 

US  Army  Foreign  Science  a 
Technology  Center 
ATTN:  AIFRC  (Dave  Hardin) 

220  Seventh  Street,  NE 
Charlottesville,  VA  22901-5396 

3  Commander 

US  Army  Foreign  Science  a 
Technology  Center 
ATTN:  AIAFRS  (Dr.  Gordon 
Spencer ) 

(Mr.  John  McKay) 
(Mr,  C.  Grobmyer) 
220  Seventh  Street,  NE 
Charlottesville,  VA  22901-5396 


No.  of 

Copies  Organization 

1  Commander 

US  Army  Foreign  Science  a 
Technology  Center 
ATTN:  AIAFRT  (John  Kosiewicz) 
Charlottesville,  VA  22901-5396 

1  US  Army  Harry  Diamond 
t  laboratories 

ATTN:  SLCHD  (Mr.  Halsey) 

2800  Powdermill  Road 
Adel phi,  MD  20783-1197 

1  US  Army  Harry  Diamond 
Laboratories 

ATTN:  SLCHD-RT  (Peter  Johnson) 
2800  Powdernd.il  Road 
Adelphi,  MD  20783-1197 

1  Commander 

US  Army  INSCOM 
ATTN:  IAOPS-SE-M  (George 
Maxfield) 

Arlington  Hall  Station 
Arlington,  VA  22212-5000 

3  Commander 

US  .V  r;ty  Missile  Cctianand 
ATTN:  AMSMI-RD 

AMSMI-RT-GC-T  (R.  Along!) 
AMSMT-~W  (J.  Bradas) 
Redstone  Arjt-n&X,  AL  35898-5500 

2  Commander 

US  Army  Missile  Command 
ATTN:  DRSMI-REX  (W.  Pittman) 

DRSMI-YRT  (Pete  Kirkland) 
Redstone  Arsenal,  AL  35898-5500 

2  Commander 

US  Army  Tank-Automotive  Command 
ATTN:  AMSTA-TSL 
AMSTA-ZS 

Warren,  MI  48397-5000 
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DISTRIBUTION  LIST 


Organization 


3  Commander 

US  Army  Tank- Automotive  Command 
ATTN:  AMSTA-RSC  (John  Bennett) 

(Walt  Wynbelt) 
(Wally  Mick) 
Warren,  MI  48397-5000 

3  Commander 

US  Army  Tank-Automotive  Command 
ATTN:  AMSTA-ZSS  (J.  Thompson) 

(D.  Reese) 

(J.  Soltez) 

Warren,  MI  48397-5000 

1  Commander 

US  Army  Tank-Automotive  Command 
ATTN:  AMSTA-NKS  (D.  Cyaye) 
Warren,  MI  48397-5000 

2  Commander 

US  Army  Tank  Automotive  Command 
ATTN:  AMSTA-RGE  (Dr.  R.  Munt) 

(R.  McClelland) 
Warren,  MI  48397-5000 

1  Director 

US  Army  TRADOC  Systems  Analysis 
Activity 
ATTN:  ATAA-SL 

White  Sands  Missile  Range,  NM 
88002-5022 

1  Commandant 

US  Army  Infantry  School 
ATTN:  ATSH-CD-CSO-OR 
Fort  Benning,  GA  31905 

1  Commander 

US  Army  Development  and 
Employment  Agency 
ATTN:  MODE-TED-SAB 
Fort  Lews,  WA  98433-5000 

1  Commander 

US  Army  Vulnerability  Assessment 
Laboratory 

ATTN:  SLCVA-CF  (Gil  Apodaca) 
White  Sands  Missile  Range,  NM 
88002-5513 


No.  of 
Copies 

1  Director 

US  Army  Cold  Regions  Research  & 
Development  Laboratory 
ATTN:  Tech  Dir  (Lewis  Link) 

72  Lyme  Road 
Hanover,  NH  03755 

1  US  Army  Corps  of  Engineers 
Assistant  Director  Research  & 

Development  Directorate 
(Military  Programs) 

ATTN:  Mr.  B.  Benn 
20  Massachusetts  Avenue,  N.W. 
Washington,  DC  20314-1000 

2  US  General  Accounting  Office 
Program  Evaluation  and 

Methodology  Division 
ATTN;  Robert  g  Orwin 
Joseph  b  nnefeld 
Room  5844 
441  G  Street,  NW 
Washington,  DC  20548 

1  Director 

US  Army  Industrial  Base 
Engineering  Activity 
ATTN:  AMXIB-MT 
Rock  Island,  IL  61299-7260 

1  Director 

US  Army  Industrial  Base 
Engineering  Activity 
ATTN:  AMXIB-PS  (Steve  McGlone) 
Rock  Island,  IL  61299-7260 

3  Commander  and  Director 

US  Army  Engineer  Waterways 
Experiment  Station 
ATTN:  WESEN  (Dr.  V.  LaGarde) 
(Mr.  W.  Grabau) 
WESEN-C  (Mr.  David  Meeker) 
P.0.  Box  631 

Vicksburg,  MS  39180-0631 
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DISTRIBUTION  LIST 


NO.  Of 
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1  Technical  Director 

US  Army  Engineer  Topographic 
Laboratories 

ATTN:  Mr.  Walter  E.  Boge 
Fort  Belvoir,  VA  22060-5546 

1  Los  Alamos  National  Laboratories 
ATTN:  MS-F600,  Gary  Tietgen 
P.0.  Box  1663 
Los  Alamos,  NM  87545 

1  Sandia  National  Laboratories 
Division  1623 
ATTN :  Larry  Hostetler 
Albuquerque,  NM  87185 

1  Sandia  National  Laboratories 
Division  1611 
ATTN :  Tom  James 
Albuquerque,  NM  87185 

1  Commander 

Naval  Material  Command 
ATTN:  F.  Gale 
Washington,  DC  20360 

1  Naval  Intelligence  Command 

ATTN:  NIPSSA-333  (Paul  Fessler) 
4600  Silver  Hill  Road 
Washington,  DC  20389 

1  Commander 

Intelligence  Threat  Analysis 
Pentftr 

ATTN:  Bill  Davies 
Washington  Navy  Yard  Bldg  203 
(Stop  314) 

Washington,  DC  20374-2136 

2  Intelligence  Threat  Analysis 

Center 

Intell  Image  Prod  Div 
ATTN :  John  Creighton 
A1  Fuerst 

Washington  Navy  Yard  Bldg  213 
(IAX-O-II) 

Washington,  DC  20310 


No.  of 

Copies  Organization 

1  Commander 

David  W.  Taylor  Naval  Ship  & 
Development  Center 
ATTN:  J.  Schot 
Bethesda,  MD  20084 

2  AFWAL/MLTC 

ATTN:  LT  Robert  Carringer 
Dave  Judson 

Wright-Patterson  AFB,  OH 
45433-6533 

1  AFWAL/AARF 

ATTN:  CPT  John  Poachon 
Wright-Patterson  AFB,  OH 
45433-6533 

1  ASD/XRJ 

ATTN:  Ed  Mahen 
Wright-Patterson  AFB,  OH 
45433 

1  AD/CZL 

ATTN:  James  M.  Heard 
Eglin  AFB,  FL  32542-5000 

1  AD/ENYW 

ATTN:  Jim  Richardson 
Eglin  AFB,  FL  32542-5000 

1  IDA 

ATTN:  Dr.  Lowell  Tonnessen 
1801  N.  Beauregard  Street 
Alexandria,  VA  22311 

1  Department  of  Commerce 

National  Bureau  of  Standards 
Manufacturing  Systems  Group 
ATTN:  B.  Smith 
Washington,  DC  20234 

1  AO  Smith 

Data  Systems  Division 
ATTN: '  H.  Vickerman 
8901  North  Kildeer  Court 
Brown  Deer,  WI  53209 
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1  Alliant  Computer  Company 
ATTN :  David  Micciche 

1  Monarch  Drive 
Littleton,  MA  01460 

2  Applicon  Incorporated 
ATTN:  J.  Horgan 

M.  Schussel 
32  Second  Avenue 
Burlington,  MA  01803 

1  Boeing  Corporation 

ATTN:  Mail  Stop  48-88  (Wayne 
Hammond) 

P.0.  Box  3707 
Seattle,  WA  98124 

1  Computer  Sciences  Corp 

200  Sparkman  Drive 
Huntsville,  AL  35805 

3  Computervision  Corporation 
ATTN:  A.  Bhide 

V.  Geisberg 
R.  Hillyard 

201  Burlington  Road 
Bedford,  MA  01730 

1  Decision  Science  Consortium, 
Inc. 

ATTN:  Mr.  T.  Bresnick 
Suite  421 

7700  Leesburg  Pike 
Falls  Church,  VA  22043 

1  Dialog  Information  Services 
ATTN:  Mr.  R.  Reklis 
3460  Fillview  Blvd 
Palo  Alto,  CA  94304 


No.  of 

Copies  Organization 

7  Environmental  Research  Institute 
of  Michigan 

ATTN:  Mr.  K.  Augustyn 
Mr.  Kozma 
Dr.  I.  La  Haie 
Mr.  Arnold 
Mr.  E.  Cobb 
Mr.  B.  Morey 
Mr.  M.  Bair 
P.0.  Box  8618 
Ann  Arbor,  MI  48107 

1  E-OIR  Measurements,  Inc. 

ATTN :  Russ  Moulton 

P.0.  Box  3348  College  Station 

Fredericksburg,  VA  22402 

6  FMC  Corporation 

Ordnance  Engineering  Division 
ATTN:  M.  Hatcher 

L.  House 
J.  Jackson 

M.  Krull 
E.  Maddox 
R.  Musante 

1105  Coleman  Ave,  Box  1201 
San  Jose,  CA  95108 

1  FMC  Corporation 

Northern  Ordnance  Division 
ATTN:  M311,  Barry  Brown 
4800  East  River  Road 
Minneapolis,  MN  55421 

1  John  Fluke  Mfg  Co,  Inc. 

ATTN:  D.  Gunderson 
P.O.  Box  C9090 
Everett,  WA  98206 

1  General  Dynamics 

Data  Systems  Services 
ATTN:  R.  Fridshal 
P.O.  Box  80847 
San  Diego,  CA  92138 
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3  General  Motors  Corporation 
Research  Laboratories 
ATTN :  J .  Boyse 
J.  Joyce 
R.  Sarraga 
Warren,  MI  48090 

1  Gettysburg  College 
Box  405 

Gettysburg,  PA  17325 

1  Global  Analytics,  Inc. 

ATTN:  Mr.  Gaelen  R.  Daum 
10065  Old  Grove  Road 
San  Diego,  CA  92131 

1  GTRI— RAIL-MAD 

ATTN:  Mr.  Joe  Bradley 
CRB  577 

Atlanta,  GA  30332 

1  Jet  Propulsion  Laboratory 
California  Institute  of 
Technology 
ATTN:  D.  Lewis 
4800  Oak  Grove  Drive 
Pasadena,  CA  91109 

1  Keweenaw  Research  Center 
Michigan  Technological 
University 
ATTN :  Bill  Reynolds 
Houghton,  MI  49931 

3  Lincoln  Laboratory 
MIT 

Surveillance  Systems  Group 
ATTN:  R.  Barnes 
G.  Knittel 
J.  Kong 

244  Wood  Street 
Lexingtru,  :**  02173-0073 

3  Lockheed- Calif oznia  Company 

ATTN:  C  A.  Burton 
R.  J.  Ricci 
M.  Steinberg 
Burbank,  CA  91520 


1  Lockheed-Georgia  Company 
ATTN:  J.  Tulkoff 
Marietta,  GA  30063 

1  LTV 

ATTN:  Mike  Logan 
P.0.  Box  225907 
Mail  Stop  194-51 
Dallas,  TX  75265 

1  Martin  Marietta  Aerospace 
ATTN:  Mr.  Dan  Dor f man 
P.0.  Box  5837  MP  113 
Orlando,  FL  32855 

3  Matra  Datavision 
ATTN:  S.  Grief 

R.  McPherson 
M,  Suarez 

99  South  Bedford  Street 
Burlington,  MS  01803 

3  Mathematical  Applications  Group, 
Inc  (MAGI) 

ATTN:  M.  Cohen 

R.  Goldstein 
H.  Steinberg 
3  Westchester  Plaza 
Elmsford,  NY  10523 

1  Megatek  Corporation 

United  Telecom  Computer  Group 
ATTN :  S .  Bryant 
880  Washington  Street 
Dedhan,  MA  02026 

1  Megatek  Corporation 

United  Telecom  Computer  Group 
ATTN:  M.  Landguth 
3985  Sorrento  Valley  Blvd 
San  Diego,  CA  92121 

1  Megatek  Corporation 

United  Telecom  Computer  Group 
ATTN:  J.  Phrohaska 
7700  Leesburg  Pike,  Suite  106 
Falls  Church,  VA  22043 
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1  Micro  Electronics  of  North 
Carolina 

ATTN :  Gershon  Kedem 
P.0.  Box  12889 
Research  Triangle  Park,  NC  07709 

1  MIT 

ATTN:  Dr.  S.  Benton 
RE15-416 

Cambridge,  MA  02139 

1  Northrop  Corporation 
Aircraft  Division 
ATTN:  Mr.  Starr 
Mail  Station  3501/84 
1  Northrop  Avenue 
Hawthorne,  CA  90250 

1  Northrop  Corporation 

Research  and  Technology  Center 
Manager,  Autonomous  Systems 
Laboratory 
ATTN:  James  R.  Reis 
One  Research  Park 
Palos  Verdes  Peninsula,  CA 
90274 

1  PDA  Engineering 
ATTN:  Lou  Crain 
1560  Brookhollow  Drive 
Santa  Ana,  CA  92705 

1  PRI,  Inc. 

ATTN:  W.  Bushell 
Building  E4435,  Second  Floor 
Edgewood  Area-APG,  MD  21010 

1  Interactive  Computer  Graphics 
Center 

Rensselear  Polytechnic  Inst. 

ATTN:  M.  Wozny 
Troy,  NY  12181 

1  RGB  Associates,  Inc. 

ATTN:  R.  Barakat 
Box  B 

Way land,  MA  01778 


No.  of 

Copies  Organization 

3  Structural  Dynamics  Research  Corp 
(SDRC) 

ATTN:  R.  Ard 

W.  McClelland 
J.  Osborn 
2000  Eastman  Drive 
Milford,  OH  45150 

1  Sigma  Research  Incorporated 
ATTN:  Dr.  Richard.  Bossi 
8710  148  Avenue  NE 
Redmona,  WA  98052 

1  Sikorsky  Aircraft 

Division  of  United  Technologies 
ATTN:  R.  Welge 
North  Main  Street 
Stratford,  CT  06602 

1  System  Planning  Corporation 
ATTN:  A.  Hafer 
1500  Wilson  Blvd 
Arlington,  VA  22209 

2  TRW  Operations  6  Support  Group 
ATTN:  K.  Danker s 

T.  Heim 
One  Space  Park 
Redondo  Beach,  CA  90278 

1  Vought  Corporation 
ATTN:  Paul  T.  Chan 
P.0.  Box  225907 
Dallas,  TX  75265 


1  Mr.  John  Bosma 

Cardinal  Communications 
Corporation 

12913  Eagle  Dancer  Trail  NE 
Albuquerque,  NM  87112 

1  Professor  Henry  Fuchs 

University  of  North  Carolina 
208  New  West  Hall  (035A) 
Chapel  Hill,  NC  27514 
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3  The  University  of  Utah 

Computer  Science  Department 
ATTN:  R.  Riesenfela 
E.  Cohen 
L.  Knapp 

3160  Merrill  Engineering  Bldg 
Salt  Lake  City,  UT  84112 

1  Science  Applications,  Inc. 
ATTN:  Terry  Keller 
Suite  200 

1010  Woodman  Drive 
Dayton,  OH  45432 

1  Science  Applications 
International  Corp 
ATTN:  Dr.  Robert  Turner 
Suite  200 

1010  Woodman  Drive 
Dayton,  OH  45432 

1  TASC 

ATTN :  Eric  Keydel 
1  Jacob  Way 
Reading,  MA  01867 

1  Thomas  Hafer 

1500  Wilson  Blvd. 

14th  Floor 

Arlington,  VA  22209 

1  XONTECH 

ATTN:  John  Dagostino 
1701  N.  Fort  Myer  Drive 
Suite  703 

Arlington,  VA  22209 

Aberdeen  Proving  Ground 

Dir,  USAMSAA 
ATTN:  AMXSY-C,  A.  Reid 
AMXSY-D 

AMSXY-G,  J.  Kramar 
AMXSY-CS,  P.  Beavers 

C.  Cairns 

D.  Frederick 
AMXSY-RA,  R.  Scungio 

M.  Smith 
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USER  EVALUATION  SHEET/CHANGE  OF  ADDRESS 


This  Laboratory  undertakes  a  continuing  effort  to  iaprove  the  quality  of  the 
reports  it  publishes.  Your  consents /answers  to  the  iteas/quettions  below  will 
aid  us  in  our  efforts. 

1.  BRL  Report  Nueber _ Date  of  Report _ 

2.  Date  Report  Received _ _ __ _ 

3.  Does  this  report  satisfy  a  need?  (Coaaent  on  purpose,  related  project,  or 

other  area  of  interest  for  which  the  report  will  be  used.) _ 


4.  How  specifically,  is  the  report  being  used?  (Inforaation  source,  design 
data,  procedure,  source  of  ideas,  etc.) _ _ 


5.  Has  the  inforaation  in  this  report  led  to  any  quantitative  savings  as  far 
as  aan-hours  or  dollars  saved,  operating  costs  avoided  or  efficiencies  achieved, 
etc?  If  so,  please  elaborate. _ 


6.  General  Coaaents.  What  do  you  think  should  be  changed  to  iaprove  future 
reports?  (Indicate  changes  to  organisation,  technical  content,  format,  etc.) 


Naae 


CURRENT 

ADDRESS 


Organisation 

Address 


City,  State,  Zip 

7.  If  indicating  a  Change  of  Address  or  Address  Correction,  please  provide  the 
New  or  Correct  Address  in  Block  6  above  and  the  Old  or  Incorrect  address  below. 


flaii 

Organisation 

ADDRESS  _ 

Address 

City,  State,  Zip 


(Reaove  this  sheet,  fold  as  indicated,  staple  or  tape  closed,  and  sail.) 


